Quantum Information and Computation, Vol. 0, No. (2005) 000-000 
© Rinton Press 



MULTIPLAYER QUANTUM MINORITY GAME WITH DECOHERENCE 



ADRIAN P. FLITNEY 

Centre for Quantum Computer Technology, School of Physics, University of Melbourne 
Parkville, VIC 3010, Australia 

LLOYD C. L. HOLLENBERG 

Centre for Quantum Computer Technology, School of Physics, University of Melbourne 
Parkville, VIC 3010, Australia 

Received (received date) 
Revised (revised date) 

A quantum version of the Minority game for an arbitrary number of agents is considered. 
It is known that when the number of agents is odd, quantizing the game produces no 
advantage to the players, but for an even number of agents new Nash equilibria appear 
that have no classical analogue and have improved payoffs. We study the effect on 
the Nash equilibrium payoff of various forms of decoherence. As the number of players 
increases the multipartite GHZ state becomes increasingly fragile, as indicated by the 
smaller error probability required to reduce the Nash equilibrium payoff to the classical 
level. 
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1 INTRODUCTION 

Game theory is the formal description of conflict or competition situations where the outcome 
is contingent upon the interaction of the strategies of the various agents. For every outcome, 
each player assigns a numerical measure of the desirability to them of that outcome, known as 
their utility or payoff. (Strictly the utility is a numerical measure and the payoff is a relative 
ordering, but for the purpose of the present work the two terms shall be used interchangeably.) 
A solution of a game-theoretic problem is a strategy profile that represents some form of 
equilibrium, the best known of which is the Nash equilibrium (NE) pQ from which no player 
can improve their payoff by a unilateral change in strategy. Originally developed for use in 
economics [2], game theory is now a mature branch of mathematics used in the social and 
biological sciences, computing and, more recently, in the physical sciences 

The Minority game (MG) , initially proposed by Challet and Zhang 4 , has received much 
attention as a model of a population of agents repeatedly buying and selling in a market 
E10IH1- In its simplest form, at each step the agents must independently select among a pair 
of choices, labeled '0' and '1.' Players selecting the least popular choice are rewarded with 
a unit payoff while the majority emerge empty handed. Players' strategies can be based on 
knowledge of previous selections and successes in past rounds. Examples of Minority games 
occur frequently in everyday life: selecting a route to drive into the city choosing a checkout 
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queue in the supermarket etc. The idea behind the Minority game is neatly encapsulated by 
the following quote: 

It is not worth an intelligent man's time to be in the majority. By definition there 
are already enough people to do that — Geoffery Harold Hardy. 

The Minority game is generally restricted to an odd number of agents, but even numbers can 
be permitted with the proviso that when the number of players selecting and 1 are equal 
all players lose. 

A game can be considered an information processing system, where the players' strategies 
are the input and the payoffs are the output. With the advent of quantum computing and the 
increasing interest in quantum information ll()j it is natural to consider the combination 
of quantum mechanics and game theory. Papers by Meyer and Eisert et al. |12| paved 
the way for the creation of the new field of quantum game theory. Classical probabilities 
are replaced by quantum amplitudes and players can utilize superposition, entanglement and 
interference. 

In quantum game theory, new ideas arise in two-player EI El EI El El El an d 
multiplayer settings (201 EH El El EI El E] In the protocol of Eisert et al. [HJ, in two 
player quantum games there is no NE when both players have access to the full set of unitary 
strategies |27| . Nash equilibria exist amongst mixed quantum strategies |13| or when the 
strategy set is restricted in some way El E] ■ Strategies are referred to as pure when 
the actions of the player at any stage is deterministic and mixed when a randomizing device 
is used to select among actions. That is, a mixed strategy is a convex linear combination 
of pure strategies. In multiplayer quantum games new NE amongst unitary strategies can 
arise |20) . These new equilibria have no classical analogues. Reviews of quantum games and 
their applications are given by Flitney and Abbott 30 and Piotrowski and Sladowski |31II32| . 

The realization of quantum computing is still an endeavour that faces great challenges |33| . 
A major hurdle is the maintenance of coherence during the computation, without which the 
special features of quantum computation are lost. Decoherence results from the coupling of 
the system with the environment and produces non-unitary dynamics. Interaction with the 
environment can never be entirely eliminated in any realistic quantum computer. Zurek gives 
a review of the standard mechanisms of quantum decoherence |34) . By encoding the logical 
qubits in a number of physical qubits, quantum computing in the presence of noise is possible. 
Quantum error correcting codes |35j function well provided the error rate is small enough, 
while decoherence free subspaces eliminate certain types of decoherence. 

The theory of quantum control in the presence of noise is little studied. Johnson has 
considered a three-player quantum game where the initial state is flipped to |111) from the 
usual 1 000) with some probability |37j . while Ozdemir et al. |38j have considered various two- 
player, two strategy (2 x 2) quantum games where the initial state is corrupted by bit flip 
errors. In both papers it was found that quantum effects impede the players: above a certain 
level of noise they are then better off playing the classical game. Chen et al. found that 
the NE in a set of restricted quantum strategies was unaffected by decoherence in quantum 
Prisoners' Dilemma |39) . while Jing-Ling Chen et al. have considered Meyer's quantum Penny 
Flip game with various forms of decoherence |40j . Decoherence in various two player quantum 
games in the Eisert protocol is considered by Flitney and Abbott ^2 E] • The quantum 
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player maintains an advantage over a player restricted to classical strategies provided some 
level of coherence remains. The current work reviews the formalism for quantum games 
with decoherence and discusses the existing results for the quantum Minority game, before 
considering the quantum Minority game in the presence of decoherence. 

2 QUANTUM GAMES WITH DECOHERENCE 

The standard protocol for quantizing a game is well described in a number of papers |12U3Ull4*3] 
and will be covered here only briefly. If an agent has a choice between two strategies, the 
selection can be encoded in the classical case by a bit. To translate this into the quantum 
realm the bit is altered to a qubit, with the computational basis states |0) and |1) representing 
the original classical strategies. The initial game state consists of one qubit for each player, 
prepared in an entangled GHZ state by an entangling operator J acting on |00. . .0). Pure 
quantum strategies are local unitary operators acting on a player's qubit. After all players 
have executed their moves the game state undergoes a positive operator valued measurement 
and the payoffs are determined from the classical payoff matrix. In the Eisert protocol this 
is achieved by applying Jt to the game state and then making a measurement in the compu- 
tational basis state. That is, the state prior to the measurement in the ./V-player case can be 
computed by 



where \i/}q) is the initial state of the N qubits, and Mfc, k — 1, . . . , N, is a unitary operator 
representing the move of player k. The classical pure strategies are represented by the identity 
and the bit flip operator. The entangling operator J commutes with any direct product of 
classical moves, so the classical game is simply reproduced if all players select a classical move. 

Lee and Johnson |48) describe a more general quantum game protocol where the prepared 
initial state need not be a GHZ state and the final measurement need not be in the com- 
putational basis. Their protocol includes the method of Eisert. Wu 03] considers a further 
generalization to a game on quantum objects. 

To consider decoherence it is most convenient to use the density matrix notation for 
the state of the system and the operator sum representation for the quantum operators. 
There are known limitations of this representation |45j : a variety of other techniques for 
calculating decoherence are considered by Brandt |4f>| . Decoherence includes dephasing, which 
randomizes the relative phase between the |0) and |1) states, and dissipation, that modifies 
the populations of the states, amongst other forms jHj- Pure dephasing can be expressed at 
the state level as 



If the phase shift <f> is a random variable with a Gaussian distribution of mean zero and 
variance 2A, the density matrix obtained after averaging over all values of (j> is |5] 
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Thus, over time, dephasing causes an exponential decay of the off-diagonal elements of the 
density matrix and so is also know as phase damping. 

An example of dissipation is amplitude damping. This could correspond, for example, 
to loss of a photon in an optical system. The effect on the density matrix is to reduce the 
amplitude of |1)(1| as well as the off-diagonal elements. 

Making a measurement with probability p in the {|0), |1)} basis on a qubit described by 
the density matrix p can be represented in the operator sum formalism by 

2 

1=0 

where £ — v / p|0)(0|, £\ = and £ 2 — \J\— pi. By the addition of further Sj's an 

extension to N qubits is achieved: 

2 

P -> H £ n ® ...®£j N p{£n® ...®£j N )\ (5) 

ji,... ,j N =0 

where, here, p is an iV-qubit state. By identifying 1 — p = e~ A , the measurement process as 
described has the same results as pure dephasing: the exponential decay of the off-diagonal 
elements of p. 

In quantum computing it is usual to consider single qubit errors caused by bit flips, 
p — > <j x pa Xl phase flips, p — ► a z pa Zl and bit-phase flips, p — > a y pa y . Depolarization is a 
process where by a quantum state decays to an equal mixture of the |0) and |1) states. It can 
be considered to be a combination of bit, phase, and bit-phase flip errors: 

P - y + (1-P)P (6) 
p 

= {^--P)P + ^o x pa x + a y pay+d z pd z , 

where 1/2 — (|0)(0| + |l)(l|)/2 is the completely mixed state. The errors given above are 
by no means an exhaustive list but consideration of them will give a good indication of the 
behaviour of our quantum system subject to random decoherence. 

The physical implementation of a quantum system determines when the decoherence op- 
erators should be inserted in the formalism. For example, in a solid state implementation, 
errors, including qubit memory errors, need to be considered after each time step, while in 
an optical implementation memory errors only arise from infrequent photon loss, but errors 
need to be associated with each quantum gate. In addition, there may be errors occurring in 
the final measurement process. In this paper we shall describe a quantum game in the Eisert 
scheme with decoherence in the following manner 



po = l^oX^ol (initial state) (7) 

pi = Jpoft (entanglement) 

P2= D(pi,p) (partial decoherence) 

P3 = {®k=iMk)P2 {®k=\Mky (players' moves) 

p4 = D(ps,p') (partial decoherence) 

p5 = pi J (preparation for measurement), 
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Fig. 1. A possible gate sequence to implement the entangling j gate. 



to produce the final state pf = p§ upon which a measurement is taken. That is, errors 
are considered after the initial entanglement and after the players' moves. In all subsequent 
calculations we set p' = p. An additional error possibility could be included after the jt gate 
but this gate is not relevant in the quantum Minority game since it only mixes states with the 
same player(s) winning 20; . Hence the gate and any associated decoherence will be omitted 
for the remainder of the paper. The J gate can be implemented by a (generalized) Hadamard 
gate followed by a sequence of CNOT gates, as indicated in figure ^ When the number of 
qubits is large the possibility of errors occurring within the J gate needs to be considered but 
is not done so here. The function D(p,p) is a completely positive map that applies some form 
of decoherence to the state p controlled by the probability p. For example, for bit flip errors 

D(p,p) = {^pa x + ^T~pir N p {Jpa x + ^l~pir N . (8) 

The scheme of Eq. Q is shown in figure [3 The expectation value of the payoff to the fcth 
player is 

($ fe > = E^<°/^ ( 9 ) 

where = is the projector onto the computational state $| is the payoff to the kth 

player when the final state is and the summation is taken over £ = . . . j'jv, ji £ {0, 1}. 

3 RESULTS FOR THE MULTIPLAYER MINORITY GAME 
3.1 Without decoherence 

In the classical Minority game the equilibrium is trivial: a maximum expected payoff is 
achieved if all players base their decision on the toss of a fair coin. The interest lies in 
studying the fluctuations that arise when agents use knowledge of past behaviour to predict 
a successful option for the next play. In the quantum game, as we shall see, a more efficient 
equilibrium can arise when the number of players is even. This paper only considers the 
situation where players do not make use of their knowledge of past behaviour. The classical 
pure strategies are then "always choose 0" or "always choose 1." A pure quantum strategy is 
an SU(2) operator: 

Mi* „ m_ ( e-cos(0/2) ie^sin^/2) \ 
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Fig. 2. The flow of information in an iV-person quantum game with decoherence, where Mj, 
is the move of the fcth player and J (JT) j s a n entangling (dis-entangling) gate. The central 
horizontal lines are the players' qubits and the top and bottom lines are classical random bits with 
a probability p or p', respectively, of being 1. Here, D is some form of decoherence controlled by 
the classical bits. Figure from Flitney and Abbott 42 . 



where 9 S [0, it] and a, (3 £ [—tt,tt]. The fcth player's move is Mk(9k,otk, Pk)- Here, I = 
M(0, 0, 0) and iX = M(tt, 0, 0) = ia x correspond to the two classical pure strategies. Entan- 
glement, controlled by a parameter 7 £ [0,7r/2], is achieved by 

J( 1 )=exp(ilaf N ), (11) 

with 7 = 7r/2 corresponding to maximal entanglement in a GHZ state. Operators of the form 
M(9, 0,0) are equivalent to classical mixed strategies, with the mixing controlled by 9, since 
when all players use these strategies the quantum game reduces to the classical one. There 
is some arbitrariness about the representation of the operators. Other representations may 
lead to a different overall phase in the final state but this has no physical significance. 

Benjamin and Hayden showed that in the four player quantum MG an optimal strategy 
arises [23]: 

s NE = — = cos( — )(i + ia x ) 
V2 16 

v 2' 16 ' 16 ; ' 

The strategy profile {s N e, s ne , s ne , s N e} results in a NE with an expected payoff of \ to each 
player, the maximum possible from a symmetric strategy profile, and twice that that can be 
achieved in the classical game, where the players can do no better than selecting or 1 at 
random. The optimization is the result of the elimination of the states for which no player 
scores: those where all the players make the same selection or where the choices are balanced. 

The strategy of Eq. I|12|l is seen to be a NE by observing the payoff to the first player when 
they vary from the NE profile by selecting the general strategy M(9, a, (3) while the others play 
s NE . Figure |3 shows the first player's payoff as a function of 9 when /3 = —a — tt/16, and as a 
function of a and (3 when 9 = n/2. The latter figure indicates that the NE is not strict: varying 



(12) 





Fig. 3. The payoff to the first player in an TV = 4 player quantum Minority game without 
decoherence when they choose the strategy (a) M(6, — 7r/16, 7r/16) or (b) M(ir/2, a, while the 
other players all select s NE . 



the strategy to M(tt/2, rj — 7r/16, rj + 7r/16), for arbitrary 77 S { — 157r/16, 157r/16} leaves the 
payoff unchanged. Specifically, the payoff to the first player when they play M(9, a, (3) while 
the others select s NE is 

{%) = \+ l -cos{^+a~(i)sine (13) 

which is maximized when = 7r/2 and 7r/8 + a — [3 — 2nir for integer n. This demonstrates 
that the strategy given in Eq. I|12|) is a NE. 

This result has been generalized to arbitrary N by Chen et al. who show that analogous 
NE occur for all even N A way of arriving at this result in our notation, with p = p' = 0, 
is to consider a symmetric strategy profile where all players choose 



(14) 
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for some S 6 K to be determined. Then, 



\4>f) 



V2 ( 



(|00...0) + i|ll...l)). (15) 



Thus, for even N, the coefficient of states in 1-0/) that have an equal number of ones and 
zeros is proportional to 

(e- i5 ) N/2 (ie- iS ) N/2 + i(e tS ) N/2 (ie t5 ) N/2 = ±(1 + i){coa(NS) - sin(NS)), (16) 

giving a probability for these states proportional to 1 — sin(2A5). This probability vanishes 
when 

S = ^^, n = !± l,±2,... (17) 

For the collective good, the vanishing of the balanced states is optimal since these are the 
ones for which no player scores. Each value of 6 gives a NE for the N even player quantum 
MG. In addition, for each S there is a continuum of symmetric NE strategies of the form 
M(tt/2,t] - S,rj + S). Figures H indicates that M(-tt/2, -tt/24, tt/24) is a NE for the six 
player MG. For A > 4 the payoffs for the NE strategies are not Pareto optimal. For example, 
for N = 6 each player scores jg compared with the Pareto optimal payoff of ^ that would 
result if all the final states consisted of two players selecting one option while the other four 
chose the second option. An alternate way of expressing the lack of optimality is to say that 
the final state prior to measurement, in the six player game, has a probability of y| of giving 
a Pareto optimal result when a measurement of the state is taken in the computational basis. 

The NE that arises from selecting S = ir/(4N) and rj = may serve as a focal point for 
the players and be selected in preference to the other equilibria. However, if the players select 
s NE corresponding to different values of n the result may not be a NE. For example, in the 
four player MG, if the players select nA,nB,nc, and nrj, respectively, the resulting payoff 
depends on (tia + ns + nc + nr>)(niod 4). If the value is zero, all players receive the quantum 
NE payoff of \, if it is one or three, the expected payoff is reduced to the classical NE value 
of |, while if it is two, the expected payoff vanishes. As a result, if all the players choose a 
random value of n the expected payoff is the same as that for the classical game (|) where 
all the players selected or 1 with equal probability. Analogous results hold for the quantum 
MG with larger numbers of players. 

When N is odd the situation is changed. The Pareto optimal situation would be for 
(A— 1)/2 players to select one alternative and the remainder to select the other. In this way the 
number of players that receive a reward is maximized. In the entangled quantum game there is 
no way to achieve this with a symmetric strategy profile. Indeed, all quantum strategies reduce 
to classical ones and the players can achieve no improvement in their expected payoffs 26 . 

The NE payoff for the N even quantum game is precisely that of the N — 1 player classical 
game where each player selects or 1 with equal probability. The effect of the entanglement 
and the appropriate choice of strategy is to eliminate some of the least desired final states, 
those with equal numbers of zeros and ones. The difference in behaviour between odd and 
even N arises since, although in both cases the players can arrange for the final state to 
consist of a superposition with only even (or only odd) numbers of zeros, only in the case 
when N is even is this an advantage to the players. Figure [S] shows the maximum expected 
payoffs for the quantum and classical MG for even N. 
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Fig. 5. The Nash equilibrium payoff as a function of the number of players (TV) for even N for the 
fully entangled quantum case (*) and the classical case (+). Compare with the Pareto optimal 
payoffs (□). The curves slowly converge to {$) = \ as N — t oo. 



3.2 With decoherence 

The addition of decoherence by dephasing (or measurement) to the four player quantum MG 
results in a gradual diminution of the NE payoff, ultimately to the classical value of | when the 
decoherence probability p is maximized, as indicated in figure^! However, the strategy given 
by Eq. i|12[l remains a NE for all p < 1. This is in contrast with the results of Johnson |37] 
for the three player "El Farol bar problem" 0Jj and Ozdemir et al. [2E] for various two player 
games in the Eisert scheme, who showed that the quantum optimization did not survive above 
a certain noise threshold in the quantum games they considered. Bit (or X), phase (or Z), 
and bit-phase (or Y) flip errors result in a more rapid relaxation of the expected payoff to 
the classical value, as does depolarization, with similar behaviour for these error types for 
p < 0.5. 

The results for the bit, phase, and bit-phase flip errors can be understood as follows. As 
the error probability is increased towards h each qubit is reduced to an equal superposition 
of the |0) and |1) states, the optimal classical strategy, and hence the classical payoff results. 
Two phase flip errors per qubit will cancel each other out so the curve for phase flip errors is 
symmetrical about p = | since the errors are applied twice (see figure |2J). For bit flip errors, 
the system approaches an equal superposition of states with an even number of zeros and ones 
as the error rate approaches one, giving a zero payoff. This effect dominates in the case of bit- 
phase flip error. In these cases a new NE profile where all agents play M(w/2, 7r/16, — 7r/16) 
emerges for p > | . This profile yields the optimum (quantum) payoff. 

Figures and |H1 show the results for the six and eight player quantum MG with decoher- 
ence. Decoherence reduces the expected payoff for the NE strategy to the classical level more 
quickly as N increases as a result of the increasing fragility of the GHZ state. 

The entanglement that gives rise to the quantum enhancement in the payoff is a global 
property of the N qubits. Decoherence in any qubit affects all the players equally, not just 
the owner of the affected qubit. In the case of phase damping — see Eq. © — where Ni players 
have decoherence probability p± and N% players have decoherence probability pi , the expected 
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Fig. 6. (a) The Nash equilibrium payoff in an N = 4 player quantum Minority game as a function 
of the decoherence probability p. The decoherence goes from the unperturbed quantum game at 
p = (right) to maximum decoherence at p = 1 (left). The curves indicate decoherence by phase 
damping (black), depolarization (red), bit flip errors (green), phase flip errors (blue) and bit- phase 
flip errors (blue-green). Compare this with (b) the Nash equilibrium payoff for N = 4 as a function 
of the entangling parameter 7 [Eq. II 1 H . 
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Fig. 7. (a) The Nash equilibrium payoff in an N = 6 player quantum Minority game as a function 
of the decoherence probability p. The decoherence goes from the unperturbed quantum game at 
p = (right) to maximum decoherence at p = 1 (left) The curves indicate decoherence by phase 
damping (black), depolarization (red), bit flip errors (green), phase flip errors (blue) and bit- phase 
flip errors (blue-green). Compare this with (b) the Nash equilibrium payoff for N = 6 as a function 
of the entangling parameter 7 [Eq. If 11 1. 
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Fig. 8. The Nash equilibrium payoff in an N = 8 player quantum Minority game as a function 
of the decoherence probability p. The decoherence goes from the unperturbed quantum game at 
p = (right) to maximum decoherence at p = 1 (left) The curves indicate decoherence by phase 
damping (black), depolarization (red), bit flip errors (blue), phase flip errors (green) and bit- phase 
flip errors (blue-green). 



NE payoff for all the players can be expressed as 



where the subscripts Ci and Q refer to classical and quantum, respectively. Expressions for 
other types of errors are more complex but remain equal for all players. The fact that all the 
players score equally has relevance to the application of quantum error correction: no player 
can advantage themselves over the other players by using quantum error correction on their 
qubit. Instead, all players benefit equally. The situation would be different, however, if a 
subset of the players shared an entangled set of qubits while the others were not entangled. 

4 CONCLUSION 

We have considered a quantum version of an .ZV-player Minority game where agents individ- 
ually strive to select the minority alternative out of two possibilities. Entanglement amongst 
the qubits representing the players' selection offers the possibility of enhancing the payoffs to 
the players compared with the classical case when the number of players is even. 

When decoherence is added to the quantum Minority game, the Nash equilibrium payoff is 
reduced as the decoherence is increased, as one would expect. However, the Nash equilibrium 
remains the same provided the decoherence probability is less than i, and is still the best result 
for the group that can be achieved in the absence of cooperation. The effect of depolarization, 
bit, phase, or bit-phase flip errors reduces the expected payoff to the classical level for an error 
probability of greater than approximately 0.2, with the drop off being steeper as the number 
of players increases. A more gradual reduction is seen with phase damping, with an expected 
payoff above the classical level unless the decoherence is maximized. 

All players are equally disadvantaged by decoherence in one of the qubits. Hence no 
player, or group of players, can gain an advantage over the remainder by utilizing quantum 



($)=($)d + (($>Q-(S) C l)(l-Pl) (JVl/2) (l-P2) (A,2/2) 



(18) 
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error correction to reduce the error probability of their qubit. However, the consideration of 
different forms of entanglement, or partial-entanglement, in the initial state is an interesting 
area for future study. The simplicity and possible application of the Minority game suggests 
that the study of the quantum version is relevant to the theory of quantum information and 
quantum entanglement. 
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